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ABSTRACT 


The polymerization of styrene-acrylonitrile (SAN) random copolymer in semi- 
batch reactors is optimized using several objective functions that are often conflicting and 
non-commensurate in nature. These include the average copolymer composition, its 
number-average molecular weight, its polydispersity index and the conversion attained in 
the reactor. Two decision/control variables are used, namely, the rate of addition of a 
continuous monomer-solvent-initiator mixture (constant composition), and the reactor 
temperature. The elitist non-dominated sorting genetic algorithm is adapted for decision 
variables that are functions of time (trajectory optimization), and used. This robust, AI 
(artificial intelligence)-based technique, enables the solution of far more complex 
optimization problems than reported in the literature. A set of several non-dominating 
(equally good) Pareto optimal solutions is obtained. These provide insights into the 
conflicting nature of the objective functions involved. An engineer (decision maker) can 
use his judgment (often intuitive) to choose the preferred solution from among these 
possibilities. 



CHAPTER 1 


INTRODUCTION 

The design and operation of industrial polymerization processes is intimately 
related to the accurate control of the operating conditions that are, in turn, related to the 
properties of polymers. It is important to (i) compute the optimal operating conditions 
(off-line optimization) required to produce polymer products having specified properties, 
and then to (ii) implement this on the industrial unit, making sure that the effect of 
disturbances is negated (on-line control). The latter may pose severe problems, partly 
because of the lack of accurate on-line sensors* for the measurement of the properties of 
the reaction mass, such as the average molecular weight (or its distribution, the MWD), 
and the monomer conversion. The focus of the present study is on the first of these two 
stages. This step is important if we wish to minimize the production of off-spec (off- 
specification) products, while simultaneously maximizing the productivity or profitability 
of the unit. 

Although continuous processes produce polymers having more consistent quality 
in large volumes (through process automation), batch or semi-batch reactors are often 
used for producing small- to medium- volume polymers. Indeed, several specialty 
polymers, including copolymers, are produced in batch or semi-batch reactors. In this 
work, we focus on the off-line optimization of the production of copolymers in semi- 
batch reactors. 

The optimization of free-radical copolymerization reactors is far more complex 
than that of homo-polymerizations, since controlling the number average molecular 
weight (and/or the MWD through the polydispersity index, Q) and the monomer 
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conversion is not sufficient. For these systems, obtaining polymer having a desired value 
of the average copolymer composition is equally important. It is well known^ that two 
styrene-acrylonitrile (SAN) copolymers differing by more than 4% in the average 
acrylonitrile content are incompatible, resulting in poor physical and mechanical final 
properties. Due to the different reactivities of the comonomers in free-radical 
copolymerization processes, composition drift occurs unless a mixture having higher 
concentrations of the more reactive monomer is added continuously (semi-batch mode) to 
the reactor. One, therefore, needs to determine how this mixture should be added to the 
reactor, as well as how the temperature in the reactor should be varied with time, so as to 
produce polymer having the desired properties, optimally (say, in as short a reaction time 
as possible). These are the two commonly used control" or decision variables. The 
objective functions and constraints could be selected from among the following: 

(a) obtain polymer having the desired value of the average composition, 

(b) obtain polymer having the desired value of the number-average molecular 
weight (or, minimize the deviations of these two properties from their desired 
values), 

(c) maximize the monomer conversion (or minimize the reaction time), 

(d) minimize the polydispersity index, Q, of the polymer. 

These objective functions and constraints are non-commensurate and are often conflicting 
in nature. The semi-batch free-radical copolymerization process, thus, is an excellent 
example of a multi-objective function optimization problem in the presence of 
constraints. For such problems, unique optimal solutions may not exist and we may 
obtain sets of several equally good (non-inferior) optimal solutions that constitute a 
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Pareto set [two non-inferior solutions are defined such that one solution has any one 
objective function better (superior) than that of the other, but this is accompanied with a 
worsening of at least one of the other objectives] These performance objectives 
compete against each other, and trade-offs among these need to be studied. The Pareto set 
provides useful insights to a decision-maker, who can then use his judgment (higher-level 
qualitative considerations)*^ to decide upon the preferred solution (operating point). 
Indeed, Paretos are becoming an increasingly effective tool to determine the necessary 
trade-offs between conflicting objectives."^ 

A simple technique used quite often for obtaining Pareto solutions is the weighted 
sum approach, where a single objective function (a weighted sum of the several 
objectives) is used. Several studies using this approach have been reported^'’ in the 1980s 
for homo-polymerizations. However, this technique has the disadvantage of hiding the 
physical significance of the individual objectives, i.e., this technique gives the solution to 
the overall problem but does not provide insights into the conflicts among the competing 
objectives. Furthermore, it requires an a priori knowledge of the weights to be used for 
each objective function, which is difficult to ascertain. These disadvantages are even 
more critical for copolymerizations. In this case, several additional objectives are 
important. For example, not all molecules formed have the same proportion of the 
reacting monomers. In addition, there is the problem of the copolymer composition 
distribution (CCD). Even for two copolymer molecules having the same overall ratio of 
the monomer units, the possibility exists for different ordering of the comonomers along 
the chain. This is the classic sequence distribution (SD) problem associated with 
copolymerizations. Each of these distributions has its own unique and profound 
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influences on the properties of the product. Clearly, the control of SD is an equally 
important objective. The trade-offs among the several objectives are important, e.g., how 
much of an MWD objective has to be sacrificed in order to gain a certain improvement in 
the CCD? We attempt to answer a few such questions in this study. 

The concept of multi-objective optimization is attributed to Pareto.^ After several 
decades, this concept was recognized in operations research and has recently become 
popular in engineering. The first application of multi-objective optimization in the field 
of polymerization was presented by Tsoukas et al.^ These workers studied the dual 
objectives: (a) narrowing the molecular weight distribution (minimizing Q of the final 
product), and (b) minimizing the deviation of the copolymer composition from a desired 
value at all times during the polymerization (minimize the integral of the square of the 
deviation). They used the e-constraint algorithm'^ and Pontryagin’s minimum principle.^ ^ 
Butala et al.‘^ formulated a slightly different two-objective optimization problem for the 
copolymerization of styrene and acrylonitrile. They minimized two integrals: (a) the 
square of the deviation of the number average molecular weight of the copolymer at time, 
t, from a desired value, and (b) the square of the deviation of the composition of the 
unreacted monomers in the reaction mass (related to the copolymer composition) at time, 
t, from a desired value. They used a self-developed interactive code, CONSOLE (using a 
search technique with parameterized control variables), to obtain solutions for this 
problem as well as for some simpler optimization problems involving only a single 
objective function. Farber’^ reported the use of a similar multiobjective optimization 
technique (e-constraint, followed by the iterative solution of the resulting Kuhn-Tucker 
problem") to determine the non-inferior solutions for the continuous copolymerizati on of 
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the styrene-acrylonitrile and methyl methacrylate-vinyl acetate systems in CSTRs 
(continuous flow stirred tank reactors) operating under steady state. They studied three 
different pairs of objective functions selected from among; (a) maximize the number 
average molecular weight, (b) maximize the conversion of monomer 1, and (c) minimize 
the deviation of the copolymer composition from a desired value. They used the 
residence time and the temperature as the two decision variables (values, and not 
functions). Interestingly, multi-objective optimization was first brought to the field of 
chemical engineering through these studies in copolymerization. Lee et al.*‘^ used genetic 
algorithm (GA) to optimize the unsteady operation of CSTRs during grade change. They 
minimized the transition time required to produce copolymer having the desired values of 
the weight-average molecular weight and the fraction of vinyl acetate (VA) in the VA- 
methyl methacrylate (MMA) copolymer, again using an integral of the square of the 
deviations. 

Most of the multi-objective optimization problems solved till now for 
copolymerization reactors have been relatively simple involving, at most, two of the 
important issues out of the four discussed earlier. Hence, there is still considerable scope 
for exploring the optimization of these reactors using more recent techniques, so as to 
obtain solutions for more complex and complete problems involving all the important 
objectives. In this work, we re-look at the multi-objective optimization of the solution 
copolymerization of styrene and acrylonitrile using an adaptation of genetic algorithm 
(GA). GA is an artificial intelligence (Al)-based technique and mimics the process of 
natural selection. It exploits the Darwinian principle of ‘survival of the fittest’ and offers 
several advantages over the earlier conventional techniques. GA, as first developed by 
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Holland^^ for single objective problems, has been adapted by several workers to solve 
problems involving multiple objectives. One such adaptation for problems involving 
decision variables that are single (optimal) values, is the non-dominated sorting genetic 
algorithm (NSGA-I) developed by Srinivas and Deb.^’^*^ Mitra et al.’^ extended this 
technique to apply to problems where the decision variables are functions of time 
(trajectory-optimization problems). Unfortunately, NSGA-I has been observed to fail in 
some cases, usually described by complex equations, e.g., for PET reactors.'* A 
modification of this algorithm, the elitist non-dominated sorting genetic algorithm 
(referred to as NSGA-II)'^ is now available in the literature that incorporates the concept 
of elitism in order to make the algorithm more powerful. This algorithm is being used for 
multi-objective optimization in the present study after being adapted to account for 
decision variables that are functions of time (trajectory optimization). Details of this 
adapted NSGA-II are provided in Appendix 1. Neither NSGA-I nor NSGA-II require 
good initial guess solutions (as for Pontryagin’s minimum principle, etc.) and NSGA-II 
leads to globally optimal solutions (instead of getting stuck, at times, at local optima, as 
does NSGA-I). In the last few years, several studies have been reported on the multi- 
objective optimization of industrial units using either NSGA-I or NSGA-II. Examples in 
chemical engineering include the optimization of homo^polymerization reactors, ’ ’ 
industrial steam reformers,^^’^* cyclone separators,^'' venturi scmbbers,^ membrane 
separation modules, fluidized-bed catalytic cracking (FCC) units,^''’^* etc. These have 
been reviewed recently by Bhaskar et al.^^ and Nandasana et al.*° Use of elitism in 
NSGA-II leads to a rapid convergence to solutions near the optimal zone,'' but, 
unfortunately, also leads to a reduction in the diversity of the solutions (gene pool), thus 
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introducing the possibility of premature convergence to false or local minima. This needs 
to be compensated for. Macro-mutations can possibly achieve this.^^ 
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CHAPTER 2 


FORMULATION 

Modeling: 

Any optimization study must be preceded with the development of a suitable 
model. Three types of important kinetic models have been reported in the open literature 
for copolymerizations. These are; (a) the penultimate effect model, (b) the diffusion 
model (accounting for the decrease in the rate constants with time, the Trommsdorff 
effect^^), and (c) the <j)-factor model.^^ The salient features of these models have been 
discussed by Odian.^^ The penultimate effect model accounts for the influence of the 
monomer unit next to the one incorporating the free radical at the end of the macro- 
radical, on the rate constants. It has considerable merit, but the experimental data required 
to estimate the rate parameters are usually not available in the open literature, except for a 
few systems. In addition, this model is quite complex and cumbersome to use. Similarly, 
expressions for the decreasing rate constants (propagation and termination) in the 
diffusion model are available for only a few systems. In contrast, the parameters for the 
(t)-factor model are reasonably well documented, and so this model is quite popular for 
solution copolymerizations, where the Trommsdorff effect is weak. 

In this work, the kinetic ((j)-factor) model of Butala et al.'^ for the solution (in 
Xylene) polymerization of styrene and acrylonitrile (SAN) using AIBN as initiator, is 
used. This model has been validated using experimental data.^^ However, the general 
procedure for optimization developed herein is in no way restricted to this model of 
copolymerization alone, and we can use it with any more sophisticated model, or for any 
other copolymerization system. 
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The kinetic scheme for free radical copolymerization of SAN is given in 
Appendix 2, while the complete set of model equations*^ is shown in Appendix 3. The set 
of ordinary differential equations of the initial value kind (ODE-IVPs) in Appendix 3 can 
be written in the following general form; 


dx/dt = F(x, u) 

(la) 

X(t = 0) = Xo 

(lb) 


where x is the set of state variables describing the system, and u is the vector of control 
or decision variables. For the problem being studied, these are given by 

x(t) = (2) 

and 

u(t) = [r(o,«(or (3) 

In Eqs. 2 and 3, Mjand are the molar concentrations of the unreacted monomers, 1 
(styrene) and 2 (acrylonitrile), respectively, I is the concentration of the unreacted 
initiator, V is the volume of the reaction mixture, (k = 0, 1, 2, . . . ) is the k* moment 
of the molecular weight distribution of the dead copolymer, T is the temperature of the 
well-mixed reaction mixture, and u is the volumetric rate of addition of the continuous 
feed of a monomer/initiator/solvent mixture (having a fixed composition) to the reactor. 
All of these are functions of the time, t, for the semi-batch reactor. No energy balance 
equation is required since T(t) is being used as a decision variable [note that T(t = 0) = 
To, the initial temperature of the material in the reactor]. 

The conversion of monomer 1 (styrene) at any time, t, for the semi-batch reactor 
can be defined as 
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( 4 ) 



and rj and r 2 are the reactivity ratios (defined in the Nomenclature). The values of the 
several rate constants for the SAN system are given in Table 1,^ while the parameters 

1 n 

describing the reactor system are given in Table 2. 

The model equations can be integrated for any specified set of input variables 
[namely, the amount and composition of the initial reaction mixture, the composition of 
the continuous feed stream, as well as T(t) and u(t)] using the D02EJF program in the 
NAG library. This code uses the Gear technique^^ for integrating stiff ODE-IVPs, and 
provides values of the output and state variables (e.g., the conversion, xi, of monomer 1, 
the composition, (|), of the mixture of unreacted monomers, the number average molecular 


10 



Table 1: Kinetic Parameters for SAN Polymerization^ 

Solvent: Xylene; Initiator: AIBN; Monomer 1: Styrene; Monomer 2: Acrylonitrile 


Parameter 

Pre-exponential factor 

Activation Energy, cal moP' 

kd 

6.02 xlO'^ s-' 

31730 

f 

0.6 


kpu 

1.06xl0'^lmor's'' 

7067 

kicii 

1.25xl0^lmor's-‘ 

1677 

kfii 

2.31xl0‘^lmor's'‘ 

12670 

kp22 

3.0 X 10’ 1 mop's-' 

4100 

ktc22 

3.3 X lO'’ 1 mop's'' 

5400 

kf22 

6.93 X lO*^ 1 moP's"' 

5837 

ri 

2.56 

1190 

^2 

6.67 X 10'^ 

-4340 

kfi2 

30x2.31xl0'^lmoP's'' 

12670 

kf2i 

5 x 6.93 X 10" 1 moP's-' 

5837 

(for ktci 2 ) 

23 

- 


* Disproportionation rate constants = 0 
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Table 2: Parameters Characterizing the Semi-batch SAN Reactor'^ 



Parameter 

Value 

Initial Feed in Reactor 

Vo 

1.01 

(Mi/M2)o 

1.0 

Mi,o 

3.81 mol r‘ 

M2,0 

3.81 mol r‘ 

So 

2.56 mol r‘ 

lo 

0.05 mol r‘ 

Solvent mole fraction 

0.25 

Continuous Feed Stream 

(Mi/M2)f 

1.5 

If 

0.05 mol r“ 

M,.f 

4.416 mol 

M2,f 

2.944 mol F* 

Solvent mole fraction 

0.25 

Reaction time 

tf 

300 min 
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weight, Mn, of the copolymer, the polydispersity index, Q, and the state variables listed in 
Eq. 2, etc., at any time, t). Some of the latter could be used directly as objective functions, 
or could be used to evaluate them. This model is, then, used for solving a few multi- 
objective optimization problems. 

Optimization: 

Several combinations of objective functions can be considered in any 
optimization study of copolymerization processes. Since both the final average molecular 
weight (and Q) and the average copolymer composition are related to the physical and 
mechanical properties of the final product, these could possibly be used in some form, 
either as objective functions or as end-point constraints. Also, we may wish to maximize 
the monomer conversion so as to maximize the production. This could be taken as yet 
another objective function (alternately, the classical time-minimization problem, 
minimization of the total reaction time, tf, could be solved). As mentioned earlier, the 
sequence distribution (SD) of monomer units along the chain is important, but since the 
present model does not provide any information on this quantity, we do not consider it as 
an objective function in the present study. In this work, we start with the solution of a few 
simple (two) multi-objective optimization problems for the SAN semi-batch reactor, 
using different combinations of these objective functions/constraints. Once some intuition 
is developed, we can use GA to obtain solutions of more complex problems than obtained 
in earlier studies.^’*^’'^ The latter would be of more relevance to real copolymerizations. 

The first two-objective optimization problem (Problem 1) solved here is the same 
as studied by Butala et al.'^ (Eqs. 43 and 44 in their paper; dimensionless form of the 
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objective function conresponding to Mn being used here). We minimize the time-averaged 
deviation of the mole ratio, <j), of the unreacted monomers from a desired value, (j); (taken 
as 1 .0 here). This ensures that the copolymer produced at every t during the reaction has 
(almost) similar composition, and in some manner, ensures a reasonably uniform 
sequence distribution (without really ensuring for this exactly). The time-averaged 
deviation of the (dimensionless) number-average molecular weight, Mn, is also 
minimized with respect to a desired value, M„.s (taken as’^ 30,000). This attempts to 
minimize, somewhat, the value of Q (while not ensuring this exactly), while 
simultaneously ensuring the production of product having a number average molecular 
weight close to the desired value. This problem can, thus, be written mathematically, as 
Problem 1: 

‘! 

Minl,(u)= \m)-<l),fdt (6a) 

0 

Min l 2 (u) = |{[M„(0-M„ (6b) 

0 

subject to (s.t.): 

323 < T{t) < 368 (K) (6c) 

0.0 <h( 0< 0.07(1 min'') (6d) 

Clearly, no emphasis is being given to the attainment of high conversions in this first 
problem, primarily to keep it simple. Also, no explicit attempt is made to obtain a 
polymer having a narrow distribution of molecular weight (low value of Q). The total 
reaction time,?^^ , is assumed to be specified (= 300 min).'^ The range of values of the 
decision variables, namely, the temperature, T(t), and the rate of addition, u(t), of the 
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continuous feed are given above, and are the same as used by Butala et al.‘^ Special (one- 
objective function) cases of this problem (also solved by Butala et al.), provide excellent 
means of testing out our multi-objective optimization code (using all the objectives in the 
code to be the same). 

The second optimization problem studied here involves two objective functions 
that are the same as those used by Tsoukas et al.^ The complete problem is described by: 


Problem 2; 

‘r 

Minl,(u)= |[F.(0-F,J-rft (7a) 

0 

Minl 2 (u)= Q{tf) (7b) 

s.t.: 

323 < T{t) < 368 (K) (7c) 

0.0 < «(r) < 0.07 (1 min'*) (7d) 


Here, Fi(t) is the mole fraction of the monomeric units, 1, in the dead copolymer chains 
at time t, while Fi,s (= 0.619) is its desired value, taken to be the same as in Tsoukas et 
al.^ The bounds on the two decision variables, the value of tf (= 300 min), the amount and 
composition of the initial feed, and the composition of the continuous feed stream, are 
those assumed in Problem 1 (the same as those used by Butala et al.*^). This has been 
done so that the results obtained for Problems 1 and 2 can be compared. It may be 
mentioned that this problem does not require the production of copolymer having a 
desired value of Mn, nor does it attempt to maximize the monomer conversion. Thus, 
Problems 1 and 2 are not the most complete multi-objective optimization problems for 
copolymer reactors, since they address only some of the important parameters. More 
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meaningful problems should address all four important issues relevant in copolymer 
manufacture: maximization of the monomer conversion (for a specified value of tf, or 
minimization of tf), obtaining polymer product having a desired value of Mn with the 
lowest value of Q, and producing copolymer of a desired composition. Two such multi- 
objective optimization problems are now described. These are much more constrained 
and so are difficult to solve for (the windows of the solutions are narrower). These have 
not been solved earlier, either. 

The first of these problems using only two objective functions (to keep it simple). 


is given by: 

Problem 3 (Reference Problem): 

Maxli(u)= xi(tf) (8a) 

Minl 2 (u)= Q{tj) (8b) 

s.t.: 

Mn(tf) = M„,s±TOLM = 30,000 ±500 (8c) 

Fi(tf) = Fi.s ±TOLf =0.600 ±0.005 (8d) 

323<r(0^368 (K) (8e) 

0.0 < u(t) < 0.07 (1 min-') (8f) 


The value of Fi,s used in this problem is different from the value of 0.619 used^ in the 
less-constrained Problem 2, and it was not possible to obtain solutions using the latter 
value of Fi,s along with the molecular weight constraint (the initial conditions, etc., used 
by Tsoukas et al.^ were different than the values being used in Problems 1-3). The bounds 
on the two decision variables, the value of tf (= 300 min), the amount and composition of 
the initial feed, and the composition of the continuous feed stream, are the same as in 
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Problems 1 and 2. The tolerances on Mn,s and Fi,s specify narrow ranges, beyond which 
penalties are imposed, as described in Appendix 1. 

Still better optimization problems for copolymer reactors would involve three (or 
more, though this would make interpretation of the results almost impossible) objective 
functions. The results of such problems are difficult to visualize, but one such problem 
(Problem 4) is being presented here, to illustrate the versatility of GA: 


Problem 4: 

Maxli(u)= (9a) 

Minl 2 (u)= Q(t^) (9b) 

'/ 

Minl 3 (u)= (9c) 

0 

s.t: 

M„ (tf)= M ± TOLm = 30,000 ± 500 (9d) 

323 < T{t) < 368 (K) (9e) 

0.0 < uit) < 0.07 (1 min’’) (9f) 


This problem addresses all four of the important issues in the optimization of copolymer 
reactors, and incorporates the best of the previous three problems. The bounds on the two 
decision variables, the value of tf (= 300 min), the amount and composition of the initial 
feed, and the composition of the continuous feed stream, are, once again, the same as 
used'^ in Problem 1. Table 3 summarizes some details of these four problems. It may be 
mentioned that minimization of tf [with an end point constraint of achieving a desired 
value of X, ) ] is not attempted here since it is similar to the maximization of x^ {tj . ) 

with tf specified. 
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Table 3: Summary of Optimization Problems Studied 



Problem 1 

Problem 2 

Problem 3 

Problem 4 


1.0 

~ 

— 

1.0 

Mn,s , kg kmol'* 

30000 

— 

30000 

30000 

tf , min 

300 

300 

300 

300 

Fi,s 

1 

0.619 

0.600 

— 

TOLm 


— 

500 

500 

TOLf 

— 

1 

i 

0.005 

— 
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CHAPTER 3 


RESULTS AND DISCUSSION 

In this study, we use the elitist non-dominated sorting Genetic Algorithm adapted 
for continuous decision variables, to solve the several multi-objective optimization 
problems described above. The code used actually maximizes all the objective functions. 
This poses no problem for objective functions that are to be minimized. However, such 
objective functions that are to be minimized, are converted to fitness functions, F [using 
F= 1/(1 + that are then maximized. For maximization of any objective, the fitness 
function and objective functions are identical. The end point constraints in some of the 
problems are taken care of by using a penalty^’'^’*’ approach. If any chromosome 
(solution) generated by NSGA-II does not satisfy the constraint within the tolerance 
specified, the value of the fitness function is artificially made very small (lO"^), so that 
this chromosome is killed quickly. 

A computer code was written in Fortran 90 to obtain the results of the multi- 
objective optimization problems described earlier, using NSGA-II. The CPU time 
required for solving a typical problem, e.g., the Reference problem (Problem No. 3), 
using a population size of 50 chromosomes and computing till the 150* generation, is 2.7 
hr on a Silicon Graphics Server (SGI Origin 200, 270 MHz, IRIX 6.5 Operating System). 
The code was first tested in the simulation mode using a single chromosome, with 
specified T(t) and u(t) [two examples described by Butala et al.^^: isothermal with u(t) = 
0; non-isothermal with specified u(t)], and the results were found to match those reported 
earlier.*^ The NSGA-II code was then tested against a few standard optimization 
problems,^’'^ both for single as well as for two and three objective functions. Several other 
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checks were also made to ensure that the code was free of errors before using it for 
generating results for the SAN reactor. The computational parameters used in NSGA-II 
for all these problems are given in Table 4. 

Fig. 1 shows the results of Problem 1. Both the objective functions [Ii, the 
cumulative deviation of the mole ratio of the unreacted monomers, and, I 2 , the cumulative 
deviation of the dimensionless number average molecular weight from their desired 
values] are to be minimized in this problem. Fig. la shows that one of the objective 
functions can be improved (decreased) only when the other worsens (increases). Thus, we 
obtain a Pareto set of non-dominant optimal solutions. More detailed investigations (the 
evolution of the Pareto set over the generations; results not shown here for brevity) show 
that the results for the lOO'*' generation do not differ much from those at the 150"^ 
generation, and one can reduce the computational time easily, at least for this simple 
problem. Figs. Ib-e show the values of some additional (and important) variables 
describing the state of the product stream, namely, the number average molecular weight, 
Mn(tf), of the product copolymer, the average mole fraction, Fi(tf), of monomeric unit, 1, 
in the copolymer produced, the conversion, Xi(tf), of monomer 1, at the end of the 
reaction, and the polydispersity index, Q(tf), of the product, for all the non-dominating 
optimal chromosomes at the 150^'’ generation. Of these four, one, namely, xi(tf), is not 
focussed upon at all in Problem 1 (the other three are at least influenced indirectly or 
directly because of the choice of the two objectives). The optimal decision variable, u(t), 
for three chromosomes. A, B and C (shown in Fig. la), are shown in Fig. 2. It may be 
noted here that Butala et al.’^ do not provide the complete Pareto set, and provide detailed 
histories only for one of the (unspecified) Pareto-optimal solutions. This is probably 
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Table 4: Values of the NSGA-II parameters^’'* used in this study 


Parameter 

Value 

No, of binaries per substring (Isu) 

10 

Maximum number of generations (Ngen) 

150 

Population size (Np) 

50 

Number of discrete points generated for each 

decision variable in the range 0 to tf (Nga) 

10 

Crossover probability (pc) 

0.98 

Mutation probability (pm) 

0.0 

Random seed number (Njeed) 

0.8765 
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Figure 2: Optimal control variable histories for the three chromosomes A, B and C 
(shown in Fig. la) for Problem 1 
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because the optimal values of both the objective functions (Fig. la) are very low (i.e., all 
the Pareto points are indistinguishable, for all practical purposes). Indeed, the three 
histories shown in Fig. 2 are almost indistinguishable. 

Figs. 3 and 4 show the results for Problem 2. Once again, Pareto solutions are 
obtained (Fig. 3a), as was obtained by Tsoukas et al.,^ who solved the same problem but 
under different (input) conditions. Lower conversions (approximately 50%) are obtained 
for this case, compared to Problem 1. The values of h are quite small, and this shows up 
in the small amount of scatter in Fig. 3c. However, there is considerable scatter in both 
Mn(tf) and Xi(tf). 

The most interesting, two-objective optimization problem that addresses almost 
all the important issues for copolymer reactors, is Problem No. 3. This is why we refer to 
this problem as the reference problem, and study it in great detail. This problem is far 
more constrained than the previous ones, because of which the window of solutions is 
relatively narrower, and obtaining the ‘correct’ optimal solutions requires a considerable 
amount of exploration of the several computational parameters of NSGA-II. Indeed, the 
parameters given in Table 4 have actually been obtained for this problem, and then used 
for solving the other problems. Figs. 5 and 6 show the results. A Pareto set of solutions is 
obtained again (Fig. 5a). It is also observed (Figs. 5b and c) that all the chromosomes 
(except a few) satisfy the narrow range of values specified for Mn(tf) and Fi(tf) [Mn(tf) = 
30,000 ± 500; Fi(tf) = 0.600 ± 0.005]. The few chromosomes violating these constraints 
are found to be generated in the previous (149*) generation. Increasing the number of 
generations would eliminate or improve these points, but at the cost of increased 
computational costs. One can easily disregard these outliers. The plots of the control 
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Figure 3 : Pareto set and state variables of optimal solutions for Problem 2 
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Figure 3 (contd.): Pareto set and state variables of optimal solutions for Problem 2 
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variables for three chromosomes. A, B and C (Fig. 5a) are given in Fig. 6. The higher 
values of xi(tf) compared to Problem 2, are to be noted. 

Problem 4 involves three objective functions and an end-point constraint. In order 
to interpret the optimal solutions, we first sort the 50 Pareto chromosomes in the order of 
increasing values of Xi(tf). Fig. 7a shows this increasing monomer conversion as a 
function of the chromosome number (re-numbered after such sorting). Fig. 7b shows the 
second objective function, Q(tf), for these sorted chromosomes. Interestingly, an increase 
in xi(tf) (improvement) is associated with an increase (worsening) of Q(tf), which is not 
surprising for an addition type polymerization. We can see the characteristics of a Pareto 
right away, without even looking at the results of the third objective function, which is 
important for copolymerization systems. The values of I3 for these chromosomes are 
observed to first decrease (improve) and then increase (worsen), as observed in Fig. 7c. It 
may be emphasized at this point that Problem 3 (involving objective functions similar to 
I2 and I3 in Problem 4) leads to a Pareto set, and that one need not obtain Paretos only 
when using xi(tf) and Q(tf) as objective functions. The interplay of the objective functions 
is quite interesting. Fig. 7d shows excellent constraint satisfaction for Problem 4. Fig. 7e 
shows the composition, Fi(tf), of the final copolymer (no constraints put on this, but it is 
controlled indirectly through I3). In contrast to Problem 1, the optimal values of I3 for this 
3-objective problem are higher, and the values of Fi(tf), exhibit greater scatter. Fig. 8 
shows the optimal histories of the two decision variables for three chromosomes shown 
in Fig. 7a. Introduction of an additional end-point constraint [Fi(tf) = Fi,s ± TOL? = 
0.600 ± 0.005] in Problem 4 gives (results not provided here) qualitatively similar results 
for xi(tf) and Q(tf), but the value of I3 falls continuously with the chromosome number 
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Figure 7 (contd.): Plots of objective functions and state variables against chromosome 
number for Problem 4 
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(i.e., the final conversion and the integrated deviation of (j) both improve as the 
polydispersity index of the product worsens). The scatter of Fi(tf) around the specified 
value becomes much less in this case. 

The effect of varying the computational parameters, pm, pc, the random seed, and 
the number of generations, on the results of Problem 3, is now studied (not all the results 
are being shown here). It is found that an increase of pm from 0 to 0.01 does not alter the 
results too much, but a further increase of pm to 0.02 significantly worsens the constraint 
violations, particularly of Fi(tf). This is accompanied by a worsening of the Pareto as 
well. The spread of the Pareto is worsened by changing the value of pc to 0.99 as well as 
to 0.90, while not affecting either of the constraint violations much. A similar thing is 
observed when the random seed is changed from 0.8765 to either 0.7654 or 0.8888. 
These results are not being provided here for the sake of brevity, and can be provided on 
request. Fig. 9 shows the development of the results (Pareto, as well as the constraint 
violations) over the generations. The Pareto set starts to appear in about the 10“^ 
generation, and there is almost no change after the 100* generation. In fact, results for the 
50* generation are quite acceptable, even though there is a small amount of improvement 
in the Pareto as the number of generations increases beyond 50. Similarly, both the 
constraint violations in the 50* generation appear to be acceptable, though some 
improvements do occur after this. 

Several additional multi-objective optimization problems can also be formulated 
and solved using NSGA-II as adapted herein for trajectory optimization cases. However, 
in this work we have presented solutions for a few problems that are more meaningful 
than those studied earlier. 
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Figure 9 (contd.): Evolution of Pareto and state variables over generations for Problem 3 
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CHAPTER 4 


CONCLUSIONS AND RECOMMENDATIONS FOR FUTURE WORK 

Conclusions: 

Multi-objective optimization of SAN polymerization in a semi-batch reactor is 
studied in this work. More complex problems involving four important properties 
relevant to copolymerization systems have been formulated and solved using adapted 
NSGA-II, than considered earlier in the literature. The technique is general arid can be 
used for other copolymerizations as well. 

Recommendations for Future Work: 

1. The model used in this work is for solution copolymerization. A more rigorous 
model for bulk polymerization, considering the Trommsdorff effect or ‘gel effect’, 
could be used. 

2. The optimization technique developed here can be extended for continuous 
reactors (CSTRs) also. 

3. The sequence distribution of the dead copolymer can be optimized to produce a 
specified type of copolymer (e.g., block or alternating copolymers). 

4. This work can be extended for the implementation of on-line inferential 
optimizing control and development of software sensors in copolymerization 
processes. 
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Appendix 1 


Elitist Non-dominated Sorting Genetic Algorithm 
NSGA-II adapted for trajectory optimization^’ (see Flowchart in Fig. Al.l) 


NOTE: The following assumes that we are maximizing all the fitness functions, Fq 

1 . Generate box, P, of Np parent chromosomes using a random-number code to 
generate the several binaries. These chromosomes are given a sequence 
(position) number as generated. Each chromosome carries information on the 
discretized decision-variable histories [i.e., each decision variable history is 
discretized and represented in terms of Nga equi-spaced points in 0 < t < tf] 

2. Map the binary coded chromosomes.^ The range in which th& first binary for 
any decision variable is mapped is as specified externally (e.g., Eqs. 6c and d). 
The remaining binaries for that decision variable are mapped adaptively in the 
range, Uj+i = Ui ± Auj, where Auj = 5 K for T(t), and AUi = 0.01 1 min"' for u(t). 
The adaptively mapped, discretized values of each decision variable are curve- 
fitted to obtain continuous functions, using a Chebyshev polynomial fitting 
subroutine (E02ACF from the NAG FORTRAN library). The model equations 
are then solved and the values of the fitness functions are evaluated. If any of 
the end-point constraints is violated, the fitness function is artificially reduced 
to a very low value (lO'^ in this work) so that they can get killed soon 

3. Classify these chromosomes into fronts based on non-domination,^’^ as 
follows: 

a) Create a new (empty) box, P’ , of size, Np 

b) Transfer i* chromosome from P to P’, starting with i = 1 

c) Compare chromosome i with each member, say, j, already present in 
P’, one at a time 

d) If i dominates^ over j (i.e., i is superior to or better than j in terms of 
all objective functions), remove the j'*’ chromosome from P’ and it put 
it back in its original location in P 

e) If i is dominated over by J, remove i from P’ and put it back in its 
position in P 
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f) If i and j are non-dominating (i.e., there is at least one objective 
function associated with i that is superior to /better than that of j), keep 
both i andj in P’ (in sequence). Test for all j present in P’ 

g) Repeat for the next chromosome (in sequence, without going back) in 
P till all Np are tested. P’ now contains a sub-box (of size < Np) of non- 
dominated chromosomes (a subset of P), referred to as the first front or 

sub-box. Assign it a rank number, Irank, of 1 

h) Create subsequent fronts in (lower) sub-boxes of P’, using Step 2b 
above (with the chromosomes remaining in P). Compare these 
members only with members present in iht current sub-box, and not 
with those in earlier (better) sub-boxes. Assign these Irank = 2, 3, ... 
Finally, we have all Np chromosomes in P’, boxed into one or more 
fronts 

i) Assign very low fitness values to chromosomes violating end-point 
constraints 

4. Spreading out: Evaluate the crowding distance, Ii, dist, for the i* chromosome 
in any front, j, of P’ using the following procedure; 

a) Rearrange all chromosomes in front j in ascending order of the 
values of any one (say, the q*) of their several objective functions 
(fitness functions). This provides a sequence, and, thus, defines the 
nearest neighbors of any chromosome in front j 

b) Find the largest cuboid (rectangle for two fitness functions) 
enclosing chromosome i that just touches its nearest neighbors in 
thef-space 

c) Ii,dist = X (sum of a/Z sides of this cuboid) 

d) Assign large values of Ii,dist to solutions at the boundaries (the 
convergence characteristics would be influenced by this choice) 

5. Make Np copies randomly (duplication permissible), of the better 
chromosomes from P’ into a new box, P” using: 

a) Select any pair, i andj, from P’ (randomly, irrespective of fronts) 

b) Identify the better of these two chromosomes. Chromosome i is 
better than chromosome j if: 

Ii, rank ^ Ij.rank- Ii, rank ^ Ij,rank 
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li, rank Ij,rank- Ii,dist ^ Ij,dist 

c) Copy (without removing from P’) the better of these two 
chromosomes in a new box, P” 

d) Repeat till P’ ’ has Np members 

Not all of P’ need be in P”. By this method, the better members of P’ 
are copied into P” stochastically 

6. Copy all of P” in a new box, D, of size Np. 

Carry out crossover (using the stochastic remainder roulette-wheel selection 
procedure)^ and mutation^ of chromosomes in D. 

This gives a box of Np daughter chromosomes. 

7. Map adaptively (as in Step 2) and evaluate fitness values (with penalty) for all 
daughter chromosomes. 

8. Elitism: Copy all the Np best parents (P”) and all the Np daughters with 
transposons (D) into box PD. Box PD has 2Np chromosomes 

a) Reclassify these 2Np chromosomes into fronts (box PD’) using only 
non-domination (as described in Step 2 above) 

b) Take the best Np from box PD’ and put into box P’” 

9. This completes one generation. Stop if appropriate criteria are met, e.g., the 
generation number > maximum number of generations (user specified). 

10. Copy P’” into starting box, P. Go to Step 2 above. 

Details of NSGA-II are from Deb'* and Deb et al.'^ 
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Elitism 


Figure A 1.1: Flowchart of elitist NSGA-II adapted for continuous variables 
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Appendix 2 
Kinetic Scheme 


Initiation: 
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(Appendix 2...Contd....b) 
Chain Transfer: 
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Appendix 3 

Model Equations’^ 


Reactor Mass Balances: 


dt 
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dt 
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Live Polymer Moments: 
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(Appendix 3 . . .contd. . . .c) 
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0 





M. 


Al 


Q = 




(A13) 

(A 14) 

(A15) 

(A16) 

(A17) 

(A18) 


* * * 
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Appendix 4 
Program Listing 


The listings of computer programs are available with the author and Prof. S. K. Gupta, 
Department of Chemical engineering, Indian Institute of Technology, Kanpur, India. 
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